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INTRODUCTION 


Problems of understanding and dealing effectively with dynamic systems of high dimension 
(large- scale dynamic systems) have been objects of research for some time. The need for better 
techniques of predicting and/or controlling dynamic behavior of large-scale systems, involving both 
modeling and analysis, has been felt more intensely as demands have increased rapidly for designing 
and managing large-scale systems (such as interconnected network of power systems, water 
resources, computers, warehouses, or depots). Despite varied and intensive research, many questions 
remain about large-scale dynamic systems for which we do not have adequate answers. 

If we assume perfect and centralized information, that is, if all “relevant” data on systems and 
environments* and complete problem descriptions are available for a single decision maker, then 
stabilization and control of large-scale systems are usually reducible to problems of constructing 
algorithms for efficient information processing (such as decomposition algorithms in large-scale 
mathematical programming) and associated problems of designing efficient information collection 
and transmission structures. Existing dynamic systems with centralized information structure are 
usually not “too” large and may have special structures because of the increasing cost of collecting 
information and processing it by a single decision maker as systems become larger. 

For large-scale systems, it is therefore likely that several decision makers exist who influence 
the dynamic behavior of large-scale systems. These systems are called decentralized systems. If we 
drop the assumption of centralized information pattern, we must explicitly recognize and cope with 
the problem of interaction of decisions and information held by several decision makers.^ In 


♦Research reported here was supported in part by AFOSR Grants 1328-67 and 72-2319. 

' We make the usual distinction of risk and uncertainty. The former is what is called purely stochastic and a 
special case of the latter is called a parameter adaptive (ref. 1). 

^Another aspect of research on large-scale systems becomes important if we retain the centralized information 
pattern but drop the assumption of perfect information. This is the aspect of learning or adaptation in decision 
making. In reality, neither assumption is likely to hold exactly. Most large-scale systems we encounter are likely to 
be imperfectly modeled and are being acted on by more than one decision maker with nonidentical knowledge of 
the system. 
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decentralized systems, no single decision maker may have enough information needed for stable 
operation of large-scale systems, to say nothing of “optimal” operation of systems.^ 

Thus, we characterize and somewhat limit the scope of our investigation on large-scale 
dynamic systems as decentralized systems and as dynamic team problems. Sharing information 
(such as choice of message alphabets and estimation and partial reconstruction of information 
content held by other decision makers) and assigning control responsibility are some of the prob- 
lems we have considered (see, for example (refs. 2-4)). Questions related to reliability, security, 
design of good measurement and control subsystems, or situations such as oligopolistic competition 
are not covered here. 

In the next three sections, we summarize our findings in (1) control of large-scale systems by 
dynamic team with delayed information sharing. (2) dynamic resource allocation problems by a 
team (here we assume a hierarchical structure with a coordinator (central agent) who coordinates 
decision making by lower-level (local) decision makers), and (3) some problems related to construc- 
tion of a model of reduced dimension. 


OPTIMIZATION BY A DYNAMIC TEAM WITH DELAYED INFORMATION SHARING 


Consider a team composed of N decision makers. Radner (ref. 5) proved that given a quadratic 
performance index for a team 

F = - u'Qu -I- 2ju'«, u' =(u\ wyyA n! = (jx\, ... . n'^) 

where Q and yt may contain random variables, the (person-by-person satisfactory) optimal decisions 
are given as the unique solution of 

£ [C// 1 K, ]“/ + ,. I,. £[Q//“/IkJ =£[/-, W,]. , = ; n 

where Jf j is the information a-field of decision maker /. This equation may be solved under a set of 
suitable assumptions by adapting an iterative solution technique used by Aoki (ref. 6)(see also ch. 2 
of ref. 7). 

To emphasize the aspect of learning or adaptation, suppose y is imprecisely known. Suppose 
further decision maker / observes dFIbu^ (i.e., his differential influence on F) through an additive 
noise. By sharing his observation with other decision makers with one period delay, the pbps 
decisions are given as the solution of a set of equations such as equation (1). The decisions consist 
of two parts: 

wf = -b (2) 


^We exclude from our consideration game situations, where decision makers may have contradictory objectives 
or problems of incentive for cooperation. 
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where is the decision vector with the centralized information structure and is the correction 
term due to individual differences in the information set at time t. 

SimUar results were obtained independently by Sandell and Yoshikawa (refs. 8,9). The stan- 
dard stochastic linear regulator problem with quadratic cost can be reformulated as a decentralized 
control problem by a team with delayed information-sharing where decision makers observe dif- 
ferent linear combinations of the state vector through noise. The structure of the decentralized 
control is still of the form of equation (2). 

It is also possible to obtain the decentralized optimal decision when some elements of Q are 
not known precisely. In this case, however, it is not possible to characterize the decentralized 
decision mles conveniently as in equation (2). (see ref. 7). 


DYNAMIC RESOURCE ALLOCATION BY A TEAM 


We now briefly describe our work which deals with a dynamic version of a stochastic resource 
allocation problem discussion by Groves and Radner (refs. 10, II). The problem is to allocate a 
finite amount of resources to n subsystems to maximize some objective function cost for the whole 
team. The amount available for allowcation depends on past decisions. Some parameters in the 
objective functions are imprecisely known."* This brings in the interactions between control and 
information, the so-called “dual control effects.” 

Some approximations must be made to approximately evaluate contributions to the objective 
function (cost) from the future (cost-to-go). The conflict arises between control and information 
since the larger the control is, the smaller is the estimation error variance of the parameter value, 
while the total amount of resource available for control is finite. Open-loop feedback, certainty 
equivalent, and other schemes are compared (see ref. 2 for details). 


AGGREGATION UNDER PERFECT INFORMATION 


Another active area of research on large-scale systems is the following: construction of models 
of similar structure and/or with smaller dimension and use of these models to stabilize and control 
large-scale systems. Several reduced-order models may be used by a single decision maker or by 
several decision makers in decentralized large-scale problems (see, e.g., refs. 13 and 14). 

In this section, we consider the feasibility of aggregating a collection of systems (called micro- 
systems or subsystems) into larger systems (called macrosystems). One part of the problem may be 
called the aggregation problem of optimal systems (or optimal configurations). It relates to the gross 
characterization of optimal system performance characteristics. The other class relates to the possi- 
bility of constructing a model, called a macromodel, or aggregates of microsystems and optimizing 
such aggregates of systems via the macromodel. 


"'This problem has never been formulated in this manner so far as we can ascertain. 
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In many control problems of physical systems, systems are naturally divided into several 
distinct subsystems because of the physical makeup of the problem. Here the word “physical” 
should be interpreted broadly to include socioeconomic systems as well as the usual, truly physical 
control systems. Loosely speaking, the concept of aggregation implies that two or more such 
subsystems are combined to make a larger subsystem. One of the objectives of such aggregation is 
usually to reduce the number of variables in the state space description of the problem. More often 
the problem is already stated in an aggregated fashion because of the sheer necessity of limiting the 
number of variables. The latter is true, for example, in describing the economic behavior of a 
country by a dynamic macroeconomic model. 

The concept of aggregation therefore complements that of decomposition. These two con- 
cepts, taken together, form two sides of a coin. In applying the concept of decomposition to a 
system to form a two-level structure, the subsystems in the lower level may be aggregated to a 
smaller number of subsystems with some advantages, for example. The concept of decomposition, 
with the resultant multilevel structure, is fairly well known and some computational algorithms 
have been proposed. The results available to date, however, are of a mathematical nature and 
somewhat of the nature of further developments of Lagrange multipliers and of generalized Kuhn- 
Tucker conditions. 

Consider a collection of subsystems whose stmctures are alike. They differ only in their 
parameter values that specify the systems completely. The problem is to allocate a limited amount 
of resources so that the overall performance (return) from these subsystems is optimized (maxi- 
mized, to be definite). The interactions among these subsystems come therefore from the common 
sources of resources. No interactions through dynamic interactions among the subsystems are 
considered. 

Consider, for example, a network of power-generating stations. Optimal performance charac- 
teristics of each power station may have the same functional dependency on the key parameter, 
such as the amount of fuel available, load of the station, capacity, etc. (see refs. 15, 16). More 
precisely, we consider a macrosystem consisting of N subsystems so that the total return from this 
system F is related to the individual return of the/th subsystem by 

F(x^ ,x^ = S g/xh 

where F and g^ are scalar valued and where x‘ is an m vector. The term F is to be maximized over 
the domain defined by 

N . . 

2 = jc, x‘ > 0. 

1 

Among the class of problems with such separable criterion functions, we are interested particu- 
larly in the special case 


g/x^) = g(x\ah, 7 < / < A 
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namely, we are interested in problems where subsystems are all alike and the return from each 
subsystem differs from each other only in its parameter so that 


max + g(x^ ,a^)^ = g 


X* + == X 


(3) 


X* > 0 , >0 

where h(a\a'^) is a known function of a* and . This means that the functional form g is 
reproduced after aggregating two subsystems, a very desirable feature indeed. Equation (3) can be 
interpreted as follows: A controller is associated with each subsystem / , and its performance is 
optimized subject to the constraint that the given amount of resource bex^ The optimal perform- 
ance is denoted by gfx^,a9, which are called the optimal performance characteristics by Kulikowski 

(ref. 15). Then the optimal performance of the aggregate of N such subsystems g|x./ 2 (a* a^)\ 

is given by® 


g |x,/ 2 (fl ' = max g^/x^-,aOj xeDj^ . 

Conditions for aggregating microvariables pertaining to dynamic behavior of subunits to obtain 
macrovariables for describing a set of subunits are usually rather restrictive. Since only a small class 
of problems permits perfect aggregation, investigating the effects of approximate aggregation is 
important. However, it is useful to know when microstate variables can be aggregated without error. 
In the dynamic resource allocation of section 2, this type of aggregation is possible for a class of 
problems. An example of perfect aggregation follows (ref. 14). 

Consider a system composed of N subsystems with the optimal performance characteristic 
functions of a common type given as 

aJ ... = kj Ki<N (4) 

where A^,....,Z^, a, co and kj > 0 are given real numbers. Assume that these A subsystems 
are coupled by the conditions 

N N N 

A = Z A:,B^Z B: Z =1 Z: 

I I I ' I ' 


where 


0<B_<B<B 


Interpret A as the total cost of control B, C,...,Z are the total amount of resources allocated to the 
N subsystems. They are constrained from below and above by 5. B, ... Z and Z. The problem is to 
minimize A. 

® In the multilevel approach (decomposition approach), the subsystems are on the first -level and the second- 
level controller assigns certain x' to the /th subsystem. 
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The optimal performance characteristics of the total system can be shown to be of the same 
type as 

...7T( = k 


where k is given by 


k = 





\ 

q 


a + j3 + . . . + CO 


and the optimal parameter value settings are given by 

t 

B*/B = ...= Z*/Z = (k^lkf 


where the starred variables indicate optimal values. 

Actually, any number of subsystems can be combined or aggregated to form a larger subsystem 
without destroying the common functional form of the optimal performance characteristics. 

For example, subsystems 1 and 2 can be combined to give 

A i2^?2 ■ - ■ ^^3 ~ 2 

where 

v4i2 — Ai A 2 
5,2 =5, +52 
Zj 2 ~ Zi + Z2 

and where 

* 

Ai 2 ^ min M, + A 2 J 

B , + B2 — B\ 2 

Z, + Z2 = Zj 2 

A{/A*2 =B*!B*2 - . . . =Z*/Z*2-(kJk,2fi- 
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Thus, for this class of problems, instead of optimizing the system with respect to variables 
7 < /■ < A/, some or all of the TV subsystems can be aggregated and optimized separately to 
form a system with fewer subsystems without incurring any loss in the overall system performance. 
This fact will be referred to as a perfect aggregation. Unfortunately, the class of functions that 
permits this perfect aggregation is not large and must be essentially of the type given by equation 
(4). Therefore, some sort of approximate aggregation procedure must be developed. One such 
approximation may be to approximate optimal operating characteristics with exponential-type 
functions. 

Note also that the subsystems of the class of systems considered by Kulikowski interact only 
indirectly through the allocation of common resources. No direct couplings of the dynamics of the 
subsystem through their inputs and outputs are considered. A network of power-generating stations 
has been mentioned as a possible system providing a motivation for such a model. 

Another important example is a network of computing centers. A computer center may be 
taken to be the basic subsystem. A local network consisting of several such centers may be con- 
sidered next. The allocation of total computing load has been considered for a computer center 
consisting of several central processing units with perhaps a common memory. What is being 
considered is not the detailed job assignment schedule but a gross characterization of optimal 
operating condition. Some job assignment schedule is assumed to have been adopted and the 
operating characteristics involving such variables as the description of the composition of the types 
of computing jobs, average times of executions, characterization of computing speed, etc., are 
assumed to be known. 

What is being proposed is to characterize the operating characteristic of a network consisting 
of two or more computing centers with similar operating characteristics in terms of similar macro- 
variables when these computing centers obtain jobs for a common source. Optimal job allocation is 
considered in terms of the given operating characteristics of the individual computer centers. Of 
course, in applying the theory to be developed in the proposed work, a major problem is to identify 
the important variables and obtain adequate characterizations. 

When the assumption of perfect information is relaxed, we can no longer perform perfect 
aggregation because of interactions between control decisions and information of various decision 
makers. 
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